Time-Symmetric Quantum Theory of Smoothing 
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Smoothing is an estimation technique that takes into account both past and future observations, 
and can be more accurate than filtering alone. In this Letter, a quantum theory of smoothing 
is constructed using a time-symmetric formalism, thereby generalizing prior work on classical and 
quantum filtering, retrodiction, and smoothing. The proposed theory solves the important problem 
of optimally estimating classical Markov processes coupled to a quantum system under continuous 
measurements, and is thus expected to find major applications in future quantum sensing systems, 
such as gravitational wave detectors and atomic magnetometers. 
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Estimation theory is concerned with the inference of un- 
known signals, given their a priori statistics as well as 
noisy observations Depending on the time at which 
the signal is to be estimated relative to the observation 
time interval, estimation problems can be divided into 
four classes: Prediction, the estimation of a signal at time 
r given observations before r; Filtering, given observa- 
tions before and up to t; Smoothing, given observations 
before and after t; and Retrodiction, given observations 
after r [2]. Among the four classes, prediction and filter- 
ing have received the most attention, given their impor- 
tance in applications that require real-time knowledge of 
a system, such as control, weather forecast, and quantita- 
tive finance. If we allow delay in the estimation, however, 
we can take into account the more advanced observa- 
tions to produce a more accurate estimation of the signal 
some time in the past via smoothing techniques. For this 
reason, smoothing is mainly used in communication and 
sensing applications, when accuracy is paramount but 
real-time data are not required. 

Conventional quantum theory can be regarded as a 
prediction theory. The quantum state in the Schrodinger 
picture represents our maximal knowledge of a system 
given prior observations. In particular, the quantum fil- 
tering theory developed by Belavkin and others [H, 0] can 
be regarded as a generalization of the classical nonlin- 
ear filtering theory devised by Stratonovich and Kushner 
Q. Quantum smoothing and retrodiction theories, on 
the other hand, have been proposed by Aharonov et al. 
as an alternative formulation of quantum mechanics 6 1 , 
Barnett et al. for the purpose of parameter estimation 7 1 , 
and Yanagisawa for initial quantum state estimation 8 1 . 
In this Letter, I generalize these earlier results on classical 
and quantum estimation to a quantum theory of smooth- 
ing for continuous waveform estimation. I am primarily 
interested in the estimation of classical random processes, 
such as gravitational waves and magnetic fields, coupled 
to a quantum object, such as a quantum mechanical os- 
cillator or an atomic spin ensemble, under continuous 
measurements. Previous studies on the use of filtering 
for these estimation problems Q model the classical sig- 



nals in terms of constant parameters or waveforms with 
deterministic evolution, but it is more desirable to model 
them as Markov processes for generality and robustness, 
in which case smoothing can be significantly more accu- 
rate than filtering Quantum estimation of a random 
optical phase process has recently been studie d by Wise- 
man and co-workers and Tsang et al. [12j, but a 
general quantum smoothing theory is still lacking. The 
theory proposed here is thus expected to find important 
applications in future quantum sensing systems, such as 
gravitational wave detectors and atomic magnetometers. 
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FIG. 1: (Color online), 
estimation problem. 



Schematic of the continuous waveform 



Consider the estimation problem schematically shown 
in Fig. [1] A vectoral classical random process Xt = 
[xi(t), . . . , x n (t)] T is coupled to a quantum system. The 
back-action of the quantum system on the classical sys- 
tem that produces xt is assumed to be negligible, so 
that the statistics of xt remain unperturbed and clas- 
sical. This assumption should be satisfied for the pur- 
pose of sensing and avoids the contentious issue of quan- 
tum back-action on classical systems 13(. The quantum 



system is measured continuously, via a weak measure- 
ment operator M (dy t ), where dy t = [dyi(t), . . . , dy m (t)] T 
is the vectoral measurement outcome at time t. De- 
fine the observations in the time interval \txiti) as 
rfj/[ tlit2 ) = {dy t ,ti <t< t 2 }. My ultimate goal is to cal- 
culate the fixed-interval smoothing probability density 
P(x T \dy[ to ,T)) at time t, conditioned upon past and fu- 
ture observations in the time interval to < t < T, so that 
the conditional expectations of x T and the associated er- 
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rors can be determined. 

Central to my derivation is the use of a hybrid classical- 
quantum density operator p t (x t ), which provides joint 
classical and quantum statistics at time t 13|, 14 1. The 
classical probability density for xt and the unconditional 
density operator can be determined from the hybrid op- 
erator by 



P{x t ) =tr [pt(x t )}, 



Pt = dx t pt{x t ), (1) 



respectively. To derive the smoothing density, I will need 
the conditional hybrid density operator p T (x T \dyt to ^) 
given past observations, and also a hybrid effect opera- 
tor, E T (dy[ T T)\x T ), which determines the joint statistics 
of future observations dy[ Tt T) given an arbitrary hybrid 
density operator p T (x T ) at time t, 



P (dy[T,T)\Pr(x T )) = dx T tr E T (dy[ T ^\x T )p T (x T ) 



(2) 



The smoothing probability density is then 

P(x T \dy[ t0iT )) 
= P{x T \dy [to ^ T) ,dy [T ^ T) 



P(x T ,dy [T}T) \dy [t(hT} ) 



P(dy[r.T)\dy[ to ,r)) 
tY[E T {dy [rX) \x T )p T {x T \dy [tQtT) )} 
J dx T tx[E T {dy[ T<T )\x r )p r {x r \dy[ tQiT ))] 



(3) 



To calculate the conditional hybrid density operator 
p T {x T \dy{ to . T )), which also solves the filtering prob- 
lem, first consider the conditional density operator 
Pr(\x[t , T )) in discrete time, which describes the quan- 
tum state given a particular trajectory of £ft , T ) = 
{x to ,x to +6t, ■ ■ - ,x T -st}, 

Pr(\x [to . T )) = K{X T -St) ■ ..K.(x to+ St)fC(xt )pt , (4) 

where pt is the initial a priori density operator, K,(xt) = 
exp[5tC(x t )] is a super-operator that governs the quan- 
tum system evolution for the time interval St indepen- 
dent of the measurement process, £ is a super-operator 
in Lindblad form, and Xt acts as a parameter of the evo- 
lution. Averaging over trajectories of cc[ toiT ), the hybrid 
density operator p T (x T ) can be expressed as 

p T {x T ) = J dx T - St . . . dx to p T ( \x [to >T ) )P(x [to , T ) , X T ) . (5) 

This expression can be verified by substituting it into 
Eqs. H]). If x t is a Markov process, P(x! totT \, x T ) — 



P(x[t ,r]) = P(x T \x T - St ) ■ ■ ■ P(x to+ St\x to )P(x to ), P(x to ) 

being the initial a priori probability density. Rearrang- 
ing the terms in Eqs. (0} and ([5]), p T {x T ) can be solved 
by iterating the formula 

p t+ st(x t+ 8t) = J dx t P(x t+ 8t\xt)IC(xt)pt(xt), (6) 

with the initial condition Pt { x t ) = Pt P(xt )- 
P(x t+ 5t\%t) for an important class of Markov processes 
can be determined from the Ito stochastic differential 
equation [l[ 



dx t = A(x t ,t)dt + B(x t ,t)dWt, 



(7) 



where dWt is a vectoral Wiener increment with 
£ {dW t } = and £{dW t dW?} = Q{t)dt. 

To calculate the a posteriori hybrid state after a mea- 
surement, the quantum Bayes theorem Q can be gener- 
alized as 



Pt(x t \Sy t ) 



J(Sy t )pt{x t ) 



J dx t tr{J(5y t )pt{x t )} ' 



(8) 



where J{b~yt)f> = M (Syt) pM< (Sy t ) . The evolution of 
the hybrid density operator conditioned upon past ob- 
servations 8y\ to ,t) = {Syta,Syt +5t,---,dyt-5t} is there- 
fore given by 



Pt+5t(xt+5t\5y[t ,t),5yt) 

_ J dx t P(xt+8t\xt)IC(xt)J{5y t )pt{xt\Syit a ,t)) 
fdx t ti[J(5y t )pt(xt\Sy[t ,t))] 



(9) 



Assuming Gaussian measurements, the measurement op- 
erator in the continuous limit is [3|, U, 1 1 51 ] 



M(dz t ) cx i + 5^7/*(*) 



1/j \ - dt. 



(10) 



where 7 M is assumed to be positive, dz t is a vectoral obser- 
vation process, and c is a vector of arbitrary operators. 
Defining dyt = U dz t and C = Uc, U being a unitary 
matrix, the measurement operator can be cast into an 
equivalent but slightly more useful form as 

M{dy t ) cx i + l -d y jR-\t)C - jC^R-\i)C, (11) 

where R is a real positive-definite matrix with eigenval- 
ues 1/7/! • The stochastic master equation for pt(xt = 
x\dy[t ,t)) = F(x, t) in the Ito sense is hence 
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g (2C ,T i?- 1 J FC* t - &PR- X 6P - FC^R^C^j j + ~ drjfR- 1 ((J - (C)p^j F + H.c 



(12) 



where dr\ t = dy t — dt(C + C')p/2 is a real vectoral Wiener increment with covariance matrix Rdt, (C)p 
| dxtr[CF(x,t)], and H.c. denotes the Hermitian conjugate. Equation (JT2J) solves the filtering problem for the hybrid 
classical-quantum system and generalizes the Kushner equation [J, [B| and the Belavkin equation Q . The continuous 
phase estimation theory proposed in Ref. [ll[ may be considered as a special case of Eq. (TT2|) . A linear version of the 
master equation for an unnormalized F(x,i), analogous to the classical Zakai equation [la ], is 



+ 1 (2C T i?- 1 /C t - C^R- l Cf - fC^R^C) | + 1 (dyjR^Cf + H.c.) , 

and F(x,t) is given by f(x,t)/ J dxtr[f(x, t)]. 

To solve for £V (dyr T ^ |x r ), rewrite Eq. ([5]) in discrete time as 



tf- 



ii?,) 



P{^y[r.T)\pr{x T )) = I dx T tr 

= I dxx tr 



E t {^V[t,T)\Xt)Pt{Xt) 



(14) 



dx T -stP(xT\xT-St)IC(x T ^ St )J(Sy T -st) ■ J dx T P[x T+ st\x r )lC(x T )J(5y T )p T (x T ) 

(15) 

Comparing Eq. (fT4|) with Eq. (fl~5|) and defining the adjoint of a super-operator O as 0*, such that tr[E(Op)] = 
tx\{0*E)p], the hybrid effect operator can be expressed as 

(16) 



Er{Sy[ T ,T)\x T ) = J* (Sy T )IC* (x T ) j dx T+St P(x T+S t\x T ) . . . J* {Sy T -st)lC* (xrst) J dx T P(x T \x T -s t )l. 
The stochastic master equation for an unnormalized Et(dy\t,T)\ x t = x) oc g(x,t) in continuous time becomes 
-dg = dt \c*{x)g + + i £ (BQB T ) ' " 



8x/ ~° >^ dx^dxv 



- (2C^ T gR- l C - gC^R- l C - C^R^Cg 



- (dyjR^gC + H.c.J , 



(17) 



which is the adjoint equation of Eq. (fT3|) . to be solved 
backward in time using the backward Ito rule and the 
final condition g(x,T) cx 1. The smoothing probability 
density is hence 



by Pardoux 17] 



h(x,r) = P(x T = x\dy [t(hT) ) 



tr[g(x,r)/(x,r)] 

fdxtr\g(x,T)f(x,T)] 

(18) 



This form of smoothing, which combines the solutions 
of adjoint equations (fl"3|) and (fl7|) . has a pleasing time 
symmetry, and can be regarded as a generalization of the 
classical nonlinear two-filter smoothing theory proposed 



Equations ([12]), (fl3]l. ([TT]). and (JTSJ) are the central 
results of this Letter and form the basis of a general 
quantum prediction, filtering, smoothing, and retrodic- 
tion theory for continuous waveform estimation. One way 
of solving them is to convert them to stochastic partial 
differential equations for quasi-probability distributions. 
For quantum systems with continuous degrees of free- 
dom, the Wigner distribution is especially helpful. Let 
f(q,p,x,t) and g(q,p, x,t) be the Wigner distributions 
of f(x, t) and g(x,t), respectively. They have the desired 
property / dqdpg(q,p, x, t)f(q,p, x, t) oc ti\g(x, t)f(x, t)}, 
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which is unkme among generalized quasi-probability dis- 
tributions [l8(. The smoothing density can then be 
rewritten as 



h(x, t) = 



J dqdpg(q,p, x, r)f(q,p, x, - 
J dxdqdpg(q,p,x,T)f(q,p,x 



(19) 



As an illustration of the smoothing theory, consider the 
estimation of a classical force, say x\(t), acting on a 
quantum mechanical harmonic oscillator, and the posi- 
tion of the oscillator is monitored, via an optical phase- 
locked loop for example 

-{i/K)[H,p\, H = (p 2 +tu 2 q 2 )/2 - x t q, and C = q. The 
linear stochastic equations for the Wigner distributions 
become 



df = dt 



P dq- + ^ q 



Xi 



dj_ 

dp 



d 



E 



d 2 



2 ^ dx u dx v 

fl.V ^ 

dy t q , 
+ r L 



(BQB T ) 



dx^ 

v J \ 8R dp 2 



(20) 



and 



-dg = dt 



+ 



dg 



dq 



— -I 

dp 
d 2 g 



dxudx v 



^ ^dx 
H 2 d 2 g 

' + m&p 2 



dy t q 
IT 9 ' 

(21) 



These equations are then identical to the classical forward 
and backward Zakai equations 1|| 17 i - If xt is Gaussian 
and the initial / is Gaussian, the means and covariances 
of the Gaussian /, g, and h can be obtained using the 



12, ia, which 



Mayne-Fraser-Potter two-filter smoother 
calculates those of / and g using forward and backward 
Kalman-Bucy filters [l[ , and then combines them to give 
the means and covariances of h. As is well known in clas- 
sical estimation theory, unless x\ is constant, the smooth- 
ing estimates and covariances cannot be obtained from 
a filtering theory alone. The reduced estimation errors 
associated with quantum smoothing can in principle be 
verified experimentally in future quantum sensing sys- 
tems. 
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